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ABSTRACT 


Emergence of Industry 4.0 in current economic trend promotes the usage 
of Internet of Things (loT) in product development. Counting people 
on streets or at entrances of places is indeed beneficial for security, tracking 
and marketing purposes. The usage of cameras or closed-circuit television 
(CCTV) for surveillance purposes has emerged the need of tools for 
the digital imagery content analysis to improve the system. The purpose 
of this project is to design a cloud-based people counter using Raspberry Pi 
embedded system and send the received data to ThingSpeak, IoT platform. 
The initial stage of the project is simulation and coding development using 
OpenCV and Python. For the hardware development, a Pi camera is used 
to capture the video footage and monitor the people movement. Raspberry Pi 
acts as the microcontroller for the system and process the video to perform 
people counting. Experiment have been conducted to measure 


Raspberry Pi the performance of the system in the actual environment, people counting 
on saved video footage and visualized the data on ThingSpeak platform. 
This is an open access article under the CC _BY-SA license. 
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1. INTRODUCTION 

A crowd is defined as a number of people gathered together in a disorderly or unsystematic way. 
There is necessity to observe, track and perceive the behaviouralof people especially in public places such as 
malls and stadium where the safety of the surrounding and security purposes are the main concerns. 
With such large number of people, it is impossible for the human surveillance operator to precisely observe 
the behaviour of the crowd. Hence, crowd management system that are able to perform people count ing are 
being designed for the purpose of facilitating the human surveillance operatorin crowd management. 

The usage of cameras and digitizers for different purposes has been blooming over the past few 
years. One of the purposes includes the use of camera or closed-circuit television (CCTV) for surveillance 
purposes, beside that, [1] shown that the CCTV can be used for the traffic management and routing solution 
of the smart parking system. This has emerged the need of tools for the digital imagery content analysis. 
Counting people on streets or at entrances of places 1s indeed beneficial for security, tracking and marketing 
purposes. Earlier surveillance systems using CCTV require human operator to monitor the camera’s input. 
Ithas become a necessity to develop an automatic people counter to aid into the action. 
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In this project, real-ttme people counter system using Pi camera and Raspberry Pi is proposed. 
Thus, the camera is set up to be hung from the ceiling to get an overhead footage of people entering 
or leaving the area of research. Algorithm of counting the passing people is developed and being described. 
At the end of this project, the captured data are shared and analysed on the cloud platform. 


2. A REVIEW OF PEOPLE COUNTER 

People counter is in high demand as it is used mainly for safety purposes, security and business. 
Some of people counting application are crowd management during Hajj in Makkah [2] and number 
of customers for business purpose. There are various methods in counting people. The methods can be 
classified into three approaches namely contact-type counters, sensors implemented system, and vision-based 
system using a camera [3]. Contact-type counters or mechanical counters which need human contact such 
as turnstiles and mat-type foot switches that can obstruct the path [4]. However, this type of counter only 
applicable for minimal people counting and it is not suitable for massive number of people, otherwise, may 
cause congestion in a high-density traffic. There are numbers of sensors used in people counter done 
by previous projects and researches such as Pyroelectric Infrared (PIR) sensors [5-8], ultrasonic sound 
distance sensor [9] and thermal sensor [10]. PIR sensors counts people when they pass through the area 
of observation (i.e. gate and door) which is mounted with a pair of IR transceiver. The sensing device form 
a straight lme which may cause counting error if any placing deviation occur. A previous research [9] uses 
ultrasonic sound distance sensor to improve accuracy and avoiding counting error. The sensor only being 
mounted on one side of the door which provide less possibility of displacement problem. Besides that, system 
uses thermalsensor only able to observe the crowd density without counting them accurately [10]. 

Earlier people counting mechanism which uses vision-based system suffers one problem as they 
unable to count the passing people precisely except when there is only a person passing through the gate 
at one time [11]. One of the proposed method uses stereo camera [12, 13] to get the vision. Stereo camera 
system able to count height and performing real-time 3D reconstruction [12]. Furthermore, the person 
and the road region on images obtained are able to be segmented accurately [13] but it removes the uses 
of only a single standard camera. Multiple camera is used in the system proposed in [14, 15] to solve 
the problem of undercounting the people walking together. Problem arises as the multiple cameras system, 
might have counted the same person several times as they move around the area of observation [14]. 
Method proposed in [15] uses approach to count crowds but they do not being individually tracked. 

Crowd monitoring develop management strategies to insure public safety and evade crowd related 
incident. At the same time, real-time crowd monitoring helps in creating an area that deals with crowds 
in asimple way efficiently. Furthermore, there are other application benefited from real-time monitoring such 
as real-time system for monitoring activity among the elderly [16] and real-time monitoring of indoor 
temperature distribution for advanced air-conditioning control [17]. Earlier visual surveillance system simply 
uses CCTV provide visual footage and information to a human operator. People detection algorithms can be 
categories into two main categories which rely on whether they work in real time or not [18]. The two 
systems are clearly differentiated even the same approach is used in each case. Focusing on the topic, 
real-time monitoring system usually get initial candidate’s location using image segmentation. There are 
several approaches; some uses human detection and tracking with acclusion [19], while the other method 
uses stereo vision or 3D information [20]. However, due to computational limitation, these approaches 
usually employ simplified person models such as ellipse and human shape templates. Others possible 
solution of crowd management implementation are, the mobile phone system with Bluetooth readings 
analysis to estimate crowd density [21] and mobile application with RFID technology [2]. 

Besides that, a realistic crowd scenario for aid of crowd management can be done by simulate 
the data captured using computer vision techniques; that can be divided into three categories which are 
pixel-based, texture analysis, and object-level analysis [22]. Pixel-based methods depend on very local 
features such as individual pixel, that generally focused on the data’s density estimation, but not able to count 
people accurately. An earlier work of pixel-based computer vision technique to obtain data from crowd 
automatically is described in [23]. However, the system is not effective if high occlusions happen. 
People counting algorithms which implement feature extraction and pattern predicting techniques 1s better 
compared to pixel-based methods as this method requires the image patches analysis [22]. 
However, the method does not identify a person individually but rather focuses on counting people in 
a scene. A previous research proposed the crowd counting algorithm which rely on texture-based motion 
segmentation technique and Gaussian process regression [24]. The crowd is initially segmented into various 
motion directions using the mixture of dynamic textures. Then, the internal edge features, segment features 
and texture features are extracted from each motion frame. The method produces good output but not 
working properly for random crowds with wrong motion as it depends on the segmentation step. 
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While, object-level analysis worked by identifying individual objects in the area. Compared to 
previously mentioned algorithm analysis method, this method tends to give a more accurate result. 
A pedestrian detection scheme using a top-down segmentation approach is proposed in [25]. Algorithm 
proposed able to spot and localize pedestrians in crowded area and with severe overlaps. However, in very 
crowded area, the lateral camera setup used can creates numbers of occlusions. A lot of methods 
and algorithm have been used, regarding people counting system with different techniques. Thus, this 
research proposed cloud-based people counter using Raspberry Pi embedded system and send the received 
data through Internet of Things (oT) platform. 


3. RESEARCH METHOD 


Figure 1 shows the flowchart of proposed method. Development of this real-time people counter 
was divided into three phases which are; people counting algorithm development, integration of developed 
algorithm into Raspberry Pi, and the integration of gained data on ThingSpeak. 


Cloud-based People Counter Gain real-time footage from Pi camera 


Develop analytical algorithm using Open 
CV and Phyton 


Implement algorithm on Raspberry Pi 











Testing on developed Analyze and visualize the 
algorithm number of peopleon 
ThinkSpeak 


Figure 1. Flowchart of proposed method 


3.1. Phase I: development of people counting algorithm 

An analytical algorithm has been developed by using OpenCV and Python to monitor and analyse 
the people and their movement. There are two version of Python, namely Python 2 and Python 3. In this 
project, Python 3 was used to develop algorithm. There were numbers of dependencies and libraries such 
as CMake and Numpy installed to ensure functionality of the system. To accomplish the algorithm 
development, the process imcludes the subtraction of consecutive frames and _ background. 
After the appropriate pre-processing stage, detected objects were being tracked based on their shape, 
size and behaviour to assess number of people present in the video frame. These algorithms can be used to 
track object as building blocks or an individual object which may be helpful in this project. 


3.2. Phase II: integration of developed algorithm into Raspberry Pi 

To develop a people counter system, the algorithm developed will be integrated with the Raspberry 
Pi. The people-counting algorithm was deployed on Raspberry Pi for analysis of the video frame which 
footage was gained from the Pi camera. Picamera was connected through Wi-Fi connection. Figure 2 shows 
the block diagram showing the process of coding integration into Raspberry Pi. There are several models 
of Raspberry Pi. The Raspberry Pi used in this project was Raspberry Pi 3 model B. This model is powered 
by 5.1V/2.5A and has a quad core 1.2GHz Broadcom BCM2837 64bit CPU. It has a faster processor 
compared to previous version such as Raspberry Pi 2. Besides that, this model came with Ethernet, 
BCM43438 wireless LAN and Bluetooth Low Energy (BLE) on board. In this project, Wi-Fi availability 
was important as the system can be accessed remotely for convenience in configuration process. 
The operating system that was installed into Raspberry Pi is Raspbian Stretch. Raspbian Stretch has been 
pre-installed with numbers of software which can be used for programming, education and other general use. 
Ithas Python, Scratch, Sonic Pi, Java and more. 
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Raspberry Pi Dependencies and tools 
configuration installation 


Integration of coding 
into Raspbery Pi 







Coding development 
using Open CV and 
Phython 





Figure 2. Block diagram of coding integration into Raspberry Pi 


3.3. Phase III: integration of data gained on ThingSpeak 

The developed algorithm then been tested on its functionality. When the algorithm was successfully 
developed, the data has been shared on the cloud medium, ThingSpeak. A ThingSpeak channel was created 
to make the data able to be shared and accessed by others. Lastly, the system performance was evaluated 
on its functionality whether the result obtained was as expected. 


4. RESULTS AND ANALYSIS 

Algorithm has been developed to count people by using OpenCV and Python on Raspberry Pi. 
In addition of the real-time Pi camera footage, a sample video was also used to test the program developed. 
The program was able to count the number of people that walked pass the area of research. 


4.1. Hardware development 

This device consist of main component, which are Raspberry Pi and Pi camera, as shown as in 
Figure 3. The device housing was made up of medium-density fiber board or better known as MDF. 
MDF is a lightweight material made up of dense wood fibers. The chosen material was important to ensure 
the device can be hang overhead on the ceiling without falling due to its weight. To keep the housing more 
water resistance, black-coloured spray paint was sprayed. The housing had a _ dimension 
of 11.2 mmx 76 mmx 50 mm. 







TOP HOUSING 
L bracket 


Ribbon cable | 


Raspberry Pi 


a BOTTOM HOUSING 
Pi camera 


Figure 3. The cloud-based people counting device 


4.2. Algorithm development 

Python programming was used to program the Raspberry Pi. By using Windows, the code 
programming for Python can be done using the IDLE, the Python’s Integrated Development and Learning 
Environment. In this project, the input for the Python came from the Pi camera and the output wasthe video 
footage gained that need to be processed and analysed forcounting people. Figure 4 shows how the algorithm 
for people counting was developed. 

The video input was gained in real-time on Picamera. In addition, some alteration in algorithm also 
allowed saved video to be processed and analysed. The grey background was removed to differentiate 
the people from other visual. The frame captured was resized, converted into grayscale and the frame was 
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being blurred. The detected objects can be tracked based on their shape or size to count the numberof people 
present in the video frame. The process of detecting a person on the frame was done by contouring technique. 
The setup threshold is for defining a minimum area depending on the video stream. For instance, if a low 
threshold is set, it will form green box around the person instead of tracing the shape of people. The line code 
was used to form two straight lines which were a blue line for upwards direction and red line for down wards 
direction, as shown in Figure 5. The algorithm for the lines can be altered to make a different line colour and 
direction. The lines formed were used as the parameter for the counter to count the people if they 


walked pass it. 
removal 


Figure 4. Algorithm development process 


Video input captured 
by camera 




















4.3. System performance 

Algorithm has been developed to count people by using OpenCV and Python on Raspberry Pi. 
In addition of the real-time Pi camera footage, a sample video was also used to test the program developed. 
The program was able to count the number of people that walked pass the area of research. This outdoor 
experiment was carried out in surrounding with different light intensity to test on the ability of system 
to detect and count people. Figure 5(a) shows the initial frame at the beginning of experiment in a higher 
light intensity. The green box was formed as the system detected the person walking in the area of 
experiment. If the person walked pass the blue line (upwards direction), the count for “IN” will increase to 1. 
In contrary, if person walked pass red line (downwards direction), the count for “OUT” will increase to 1. 
The initial count for both directions are set to 0. Figure 5(b) shows the frame captured which happen after the 
person walked through the lines. The counter for “IN” has increased to | after the person walked past 
the blue line. This shows that the device was able to process that someone was walking under the camera 
and able to count asthe person walked through the line. 


8 OOS hm » +) [egy 1218 





(a) (b) 
Figure 5. The camera frame, (a) At the beginning of experiment, (b) After people walked past the lines 
Figure 6 shows the experiment result by using a saved video footage. In this experiment, when 
people walked through the blue line and walking downwards direction, the counter at top left for “DOWN” 


will increase subsequently. Meanwhile, if they were going upwards and walked pass the red line, the counter 
for “UP” will increase. Table 1 show the number of people counted during program simulation. 
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However, there were several errors that occurred. This might be due to several factors that affecting 
the process of counting. One of the factors was the brightness of footage captured. The algorithm might not 
be able to do background subtraction accurately which result in object being miscounted. For example, from 
the video captured at 14:58:16 pm, the actual number of people walked past the line was two people, but it 
was only being counted as one. 

The data gained was then been analysed and visualised on the cloud platform, which is ThingSpeak. 
Figure 7(a) and (b) show the graph of data analysed on ThingSpeak for both result for the number of people 
“DOWN” and “UP”, respectively. For this data analysis, the data was taken from the experiment by using 
video footage as shown on Table |. Data was tabulated and uploaded manually on ThingSpeak website using 
a CSV file. The graphs also showed the exact trmestamp of when the number of people were counted. 


Table 1. The numberof people counted 
during simulation 





Total number 
Actual number of 
of people 
Timestamp people counted on 
(pm) video footage counted from 
simulation 
Simulation Actual Down Up 
14:58:04 +] +1 1 0 
14:58:10 +] +1 1 0 
14:58:15 +] +1 1 0 
14:58:16 +] +2 0 1 
14:58:18 +1 0 1 0 
14:58:19 +1 +1 1 0 
14:58:20 +2 +2 0 2 
14:58:25 +] +2 1 0 


Figure 6. The result of video processing on a saved 
video footage 


Field 1 Chart Con Ae 


Field 2 Chart 
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(a) (b) 
Figure 7. The graph of, (a) Number of people going downwards, (b) Number of people going upwards 


5. CONCLUSION 

Discussion in previous chapters described how the people counting system was being developed. 
The development method was based on analytical algorithm by using OpenCV and Python, Pi camera 
anda Raspberry Pi 3 with Raspbian operating system installed. The important features of this system include 
the ability to count people in real-time in the video footage captured and sending the statistic and data to 
cloud medium, ThingSpeak. The algorithm which was able to process the video received has been 
successfully developed by using OpenCV and Python. The developed algorithm was integrated into 
Raspberry Pi and the data are uploaded on ThingSpeak platform. However, there are some unfortunate 
limitation that caused the outcome to not fulfil some of the objectives for this experiment. 
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